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THE APPLICATION TOENTIFIED ABOVE HAS BEEN EXAMINED AND IS ALLOWED FOR ISSUANCE AS A PATENT. 
PROSECUTION ON THE MERITS IS CLOSED . THIS NOTICE OF ALLOWANCE IS NOT A GRANT OF PATENT RIGHTS. 
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I. Review the SMALL ENTITY status shown above. 

If the SMALL ENTITY is shown as YES, verify your current 
SMALL ENTITY status: 

A. If the status is the same, pay the TOTAL FEE(S) DUE shown 
above. 

B. If the status is changed, pay the PUBLICATION FEE (if 
required) and twice the amount of the ISSUE FEE shown above 
and notify the United States Patent and Trademark Office of the 
change in status, or 



If the SMALL ENTITY is shown as NO: 

A. Pay TOTAL FEE(S) DUE shown above, or 

B. If applicant claimed SMALL ENTITY status before, or is now 
claiming SMALL ENTITY status, check the box below and enclose 
the PUBLICATION FEE and 1/2 the ISSUE FEE shown above. 

□ Applicant claims SMALL ENTITY status. 
See 37 CFR 1.27. 
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III. All communications regarding this application must give the application number. Please direct all communications prior to issuance to 
Mail Stop ISSUE FEE unless advised to the contrary. 

IMPORTANT REMINDER: Utility patents issuing on applications filed on or after Dec. 12, 1980 may require payment of 
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□ "Fee Address" indication (or "Fee Address" Indication form 
PTO/SB/47; Rev 03-02 or more recent) attached. Use of a Customer 
Number is required. 



2. For printing on the patent firont page, list (1) the 
names of up to 3 registered patent attorneys or 
agents OR, alternatively, (2) the name of a single 
firm (having as a member a registered attorney or 
agent) and the names of up to 2 registered patent 
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Notice of Allowability 
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TTie MAILING DATE of this communication appears on the cover sheet with the correspondence address- 

All claims being aliowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
of the Office or upon petition by the applicant. See 37 CFR 1.313 and MPEP 1308. 

1 . S This communication is responsive to 6/5/03 , 

2. S The allowed claim(s) is/are 1-40 and 49 . 

3. □ The drawings filed on are accepted by the Examiner. 

4. □ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-{d) or (f). 

a) □ All b) □ Some* c) □ None of the: 

1. □ Certified copies of the priority documents have been received. 

2. □ Certified copies of the priority documents have been received in Application No. . 

3. □ Copies of the certified copies of the priority documents have been received in this national stage application from the 

International Bureau (PCT Rule 17.2(a)). 
* Certified copies not received: . 

5. □ Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 119(e) (to a provisional application). 

(a) □ The translation of the foreign language provisional application has been received. 

6. im Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121. 

Applicant has THREE MONTHS FROM THE "MAILING DATE" of this communication to file a reply complying with the requirements noted 
below. Failure to timely comply will result in ABANDONMENT of this application. THIS THREE-MONTH PERIOD IS NOT EXTENDABLE. 

7. □ A SUBSTITUTE OATH OR DECLARATION must be submitted. Note the attached EXAMINER'S AMENDMENT or NOTICE OF 
INFORMAL PATENT APPLICATION (PTO-152) which gives reason(s) why the oath or declaration is deficient. 

8. M CORRECTED DRAWINGS must be submitted. 

(a) K including changes required by the Notice of Draftsperson's Patent Drawing Review ( PTO-948) attached 

1) S hereto or 2) □ to Paper No. . 

(b) □ including changes required by the proposed drawing correction filed , which has been approved by the Examiner. 

(c) □ including changes required by the attached Examiner's Amendment / Comment or in the Office action of Paper No. . 

Identifying Indicia such as the application number (see 37 CFR 1.84(c)) should be written on the drawings in the front (not the back) of 
each sheet. 

9. □ DEPOSIT OF and/or INFORMATION about the deposit of BIOLOGICAL MATERIAL must be submitted. Note the 
attached Examiner's comment regarding REQUIREMENT FOR THE DEPOSIT OF BIOLOGICAL MATERIAL. 



Attachment(s) 

ID Notice of References Cited (PTO-892) 
3n Notice of Draftperson's Patent Drawing Review (PTO-948) 
5n Information Disclosure Statements (PTO-1449), Paper No. 
?□ Examiner's Comment Regarding Requirement for Deposit 
of Biological Material 



20 Notice of Infomnal Patent Application (PTO-152) 

40 Interview Summary (PTO-413), Paper No. . 

en Examiner's Amendment/Comment 

8|3 Examiner's Statement of Reasons for Allowance 

90 Other 
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DETAILED ACTION 



RCE & Amendment 



1 . Applicant's Request For Continued Examination (RCE) and amendment, filed 
6/6/03, have been received ard^tered. Independent claims 1 , 20, 31 , and 40 have 
been amended. Claims 41-48 have been canceled. 



2. An examiner's amendment to the record appears below. Should the changes 
and/or additions be unacceptable to applicant, an amendment may be filed as provided 
by 37 CFR 1.312. To ensure consideration of such an amendment, it MUST be 
submitted no later than the payment of the issue fee. 

Authorization for this examiner's amendment \Nas given in a telephone interview 
with David Jacobson on March 8*^, 2004. 

The application has been amended as follows: 



EXAMINER'S AMENDMENT 
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Art Unit: 3627 

Claim 1 has been amended as follows - 

1 . A point-of-sale commercial transaction processing system for processing a customer 
transaction based upon a verbal instruction from the customer, comprising: 

a) a first customer interaction terminal (CIT) adapted to receive the verbal instructions 
from a customer and convert the verbal instruction into an audio signal; 

b) a first computer system in communication with said first CIT and including an 
artificial intelligence (A!) system which receives said audio signal and semantically 
processes said audio signal to at least partially recognize the verbal instruction from the 
customer, said A! system adapted to parse the verbal instruction using grammatical 
syntax; and 

c) a human-controlled response system in communication with said first computer 
system and adapted to automatically intervene to interact with the customer when said 
Al system has not satisfactorily semantically processed the verbal instruction from the 
customer. 
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Claim 20 has been amended as follows - 
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20. A method of processing a commercial transaction, comprising: 

a) providing an interactive terminal; 

b) eliciting a verbal instruction from a customer to the interactive terminal; 

c) upon receiving verbal instruction from the customer to the interactive terminal, 
I semantically processing the verbal instruction with artificial intelligence (A!) routines, 

said A! routines adapted to parse the verbal instruction using grammatical syntax; and 
I d) upon automatically determining by the A! routines thatjhere^^ 

semantic processing, intervening by a human to process the verbal instruction. 



Claim 31 has been amended as follows - 




'S^^ A method of processing a commercial transaction with a customer, comprising: 

a) with an artificial intelligence (Al) processor located in a first building, communicating 
with the customer who is also located in the first building, said Al processor adapted to 
parse a verbal instruction using grammatical syntax; and 

b) providing real-time human support from a second building different from said first 
building to said Al processor located in said first building for processing said 
communication. 



^5 



0 



Application/Control Number: 09/657,719 
- Art Unit: 3627 

(claim 40 has been amended as follows - 

method of processing a commercial transaction with a customer, comprising: 




a) with an artificial intelligence (A!) processor located in a first building, communicating 
with the customer who is also located in the first building, said A! processor adapted to 
parse a verbal instruction using grammatical syntax; and 



b) transferring the communication from between the customer and the A! processor to 
between the customer and a human who is located in a second building different from 
said first building, wherein said transferring is substantially seamless such that the 
customer is substantially unaware of the transferring. 
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p^w claim 49 has been added as follows - 



'^^ff^ method according to claim 20, further comprising: 

Upon determining by the customer that there is a problem in said semantic processing, 
intervening by a human to process the verbal instruction. 
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Drawings 



3. The application having been allowed, formal drawings are required in response 
to this Office Action. 



4. Claims 1 -40 are allowed. 

5. The following is an examiner's statement of reasons for allowance: 
Claims 1 and 20 recite the limitations of a customer terminal which receives 

verbal instructions, a computer using artificial intelligence (Al) which semantically 
processes an audio signal, and a human-controlled response system. This full 
combination of limitations is not shown or taught by the prior art of record. The 
Schneider appears to be the closest reference, but applicant limits the broad term Al 
and has amended to specify that the invention semantically processes the audio signal 
and has the ability to parse the verbal instruction using grammatical syntax. The 
examiner does not believe that there would motivation to replace the "voice recognition" 
(VR) of Schneider with an improved Al system because the VR was merely an alternate 
embodiment for the simple system of buttons 1 to 10. 

Claims 31 and 40 recite limitations focusing on the location of the elements of the 
claim. The claims recite an Al system communicating with a customer where both are 
located in a first building and providing real-time human support from a second building. 
Store environments, such as Schneider, teach away from having the human support in 



Allowable Subject Matter 
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a different building. The other uses for Al appear more in the decision making areas, 
not communication. The Wren reference shows a customer system, which uses Al, but 
it uses Al to monitor the customer's actions and to make a decision when to volunteer 
assistance (bottom column 15). The Wren Al system is also located in a different 
building from the customer. The examiner believes that the full combination of 
limitations recited by claims 31 and 40 are not shown nor taught by the prior art of 
record. 

Any comments considered necessary by applicant must be submitted no later 
than the payment of the issue fee and, to avoid processing delays, should preferably 
accompany the issue fee. Such submissions should be clearly labeled "Comments on 
Statement of Reasons for Allowance." 

Conclusion 

6. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. Wren shows a sales system with remote customer and an Al 
system. Sloane et al, shows a shopping system of interest. Eastman Kodak system 
shows a remote monitoring system with Al of interest. Long et al. article shows a real- 
time remote monitoring system of interest. 

7. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Michael Cuff whose telephone number is (703) 308- 
0610. The examiner can normally be reached on 8:00 to 5:30. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Robert Olszewski can be reached on (703) 308-5183. The fax phone 
number for the organization where this application or proceeding is assigned is 703- 
872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 



Michael Cuff 
May 6, 2004 




